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Abstract 

Consider a pure birth process with intensities — jj^, with k = 0,1,2,..., we show that 
the subordinated chain is assimilable to a Bernoullian scheme with dependent successes prob- 
abilities, also we show a direct link with a degenerate Polya urn replacement scheme [3]. We 
compute explicitly transition probabilities, by generating function method, of the subordinated 
chain and give some interesting bounds using the centering sequence approach proposed by 
MacDiarmid [2]. 

1 Introduction 

A pure birth process with intensities Ao,Ai,... > is a process {X{t) : t > 0} taking value in 
S = {0, 1,2,...} such that: 

X{0) > 0; if s < t then X{s) < X{t), 

{Knh + o(h), if m—l 

o{h), if m > 1 

1 - X,nh + o{h), if TO 

if s < t then, conditional on the value of X{s), the increment X{t) — X{s) is independent of all 
arrivals prior to s. 

If A„ = A for all n a birth process with intensity Ag, Ai, ... is called Poisson process. 

Now consider a pure birth process with intensities A^ = with fc > where A > 0. 
Let p{k,t) = PiX{t) = k) where {X{t) : t > 0} then 



p'(0,t) = Ap(0,t 
p'{k,t) = ^p{k- 

In the following, without loss of generality, we choose A 



p'(k,t) = ^pik-l,t)-j^pik,t), if k^O W 



It is known that this problem has a unique positive solution and because J2t^ X" ~ ^^'^ solu- 
tion is a proper probability distribution see [T]. 
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Proposition 1.1. Let 



then (0) is the solution of (QJ). 
Proof 

Obviously p{0,t) = e~*. Now taking Laplace transform 



from ll]) we have 



p{k,e) := / e-'^*p{k,t)dt 
Jo 



so that 



Ai , A2 



ife+i 



1 



where Ai, i = I, k + 1, satisfy the following equations 

fc+l / , \ k+l 



i=l;i^l 



1 

fc+l 



fc+l 



A. n (^+7)+^^ n (^+7)+^^- n ^+7)=' 



Choosing 9 — — i, j — 1, fc + 1, we obtain: 



0, Vj^ 



A 



Anti-transforming then for A: > 1 



(2) 



(3) 



(4) 



^ fc+l fc+l fe+i ^ 



i=i 



n 



j=l j=l;i#j 



From (|4]) we know that 



fc+l 



fc+l 



Let 



2 



Qr- n W 

Taking the logarithm of ([5]) after some algebraic calculations we obtain 

(fc + 1)! + 
then the thesis follows. 

□ 

2 Subordinated chain 

We remember briefly how to construct a generic subordinated chain. 

A random point process on the positive half-line is a sequence {T'„}„>o of nonnegativc random 
variable such that, almost surely, 

To = 

< Ti < < - 
lim T„ — +00 

nf+oo 

Definition 2.1. Let {Xn}n>o &e a discrete-time HMC with countable state space E and transition 
matrix K = {fci.jji.jeB and let {T„}„>i be an HPP on with intensity A and associated counting 
process N . Suppose that {Xn}n>o o,nd {r,i}n>i are independent. The process {X(t)}t>o with value 
in E defined by 

X{t) = XN(t) (6) 

is called uniform Markov chain. The Poisson process N is called the clock, and the chain {Xn}n>o 
is called the subordinated chain. 

Let {Xn}n>o a homogeneous discrete Markov chain with countable state space Ng, considering the 
transition probabilities 

P(X„+i = j |X„ = i) = ^ , j=i + l 

P(X„+l=j|X„=2) = ^, J^l 

then from definition (jG]) {Xn}n>o is the uniform Markov chain of the birth process {X{t)}t>o with 
associated differential equation ([T]). 

Let pn,k = P{Xn = k) from ([7]) we obtain the following equations: 

Pn+l,k = k^Pri.k + ^Pri,fc-1, Vn>0, l<fc<n+l 

Kj=0, t>0, j>t + l (8) 
Po,o = 1, Pn,0 =0, n > 1 
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□ 



Proposition 2.2. Let p„_fc as in ^ then 
Proof 

See Appendix. 

2.1 Urn interpretation via dependent Bernoullian scheme 

Consider an urn containing only one white ball and an arbitrary number of red balls. If we draw 
the white ball then we add a red ball, while if we draw a red ball we do not anything. In both cases 
we reinsert the drawn ball and proceed to the next drawing. 

This urn is a special type of Polya urn, see [3], corresponding to the following replacement scheme: 

ill) 

This Polya urn is assimilable to a sequence of dependent Bernoulli random variables, in fact if we 
consider that the number of red balls in the urn corresponds to the number of previous successes 
then the probability of next success depends only on this number. 



□ 



Proposition 2.3. Let Zn = J2^=a ^ ^ Oj where 

y„|yo,...,yn-i-i?er( J^„, ); = (10) 

then Zn = Xn, where the probability distribution of Xn is given by 
Proof 

It is sufficient to observe that the distribution of Z„ satisfies ([8]). 
Remark 

The limit distribution of Z„ is normal, see [3] theorem 1.5. 

Now we recover the mean of the subordinated chain, i.e. the mean number of red balls in the urn 
after n steps. 

Let {Ti}i>i be a increasing sequence of positive r.v. such that y„ = 1 if and only if n ~ ti for some 
i. 

We have that: 

p{n = n) = P(n._,+i = 0, = 0, y„ = 1) 

where Ym ~ Ber{j), with m & [ri-i + 1, n]. 
Then we have that ^ Geom{i). 
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Knowing that P{Xn = fc) = P(^^=i Yi ^ k) P{Yl!i=i '''i — if consider the r.v. T 
X]i=i ''"i' i-®- number of trials necessary to obtain k successes, we have 



E[T)^E{Y,r^=j2^ 

\i=l I 1=1 

Solving the equation -B(T) = n, with respect to the variable fc, i.e. ^^^'^^'^ = we find 



^ + (11) 

We want to give a result of weak concentration for the embedded process X„ . For this purpose we 

give an upper bound for the variance. 

Consider pUj) . for the second moment of X„ holds 



E{Xl^^) = E{E{Xl^^\X,:)) = E{E{{X^ + Y^+,f\X^)) 



1+ 

E[X'i + + 2X„ 



1 + X„ 1 + Xn 



so that 



i?(X,2,+i)<2 + i?(x2) 
Being E{Xl) < 1 wc obtain ^(X^) < 2?! then 



-l + ^/TTWl 



Var[Xr.) <2n- ^ j = -- + \/TT8^ (12) 

Proposition 2.4. Lei {X„}„>o i/ie process with probability distribution function as in (B^, then 
for n — ?> +CO 

P(|X„ - E{X,,)\ > eEiX^)) < ^ ^ (13) 

Proo/ 



It is an obvious consequence of (HJ), (|12p and Chcbychev's inequality. 

□ 

Considering the BcrnouUian scheme representation (j2.3[) for the subordinated chain, we establish 
the large deviation bounds using some results due to McDiarmid [2]. 

To this purpose we recall the definition of centering sequences and some result about them. 
For more details see [5]. 
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Definition 2.5. Given a sequence X = {Xi^X2, ■■■) of (integrable) random variables the corre- 
sponding difference sequence is Y = {Yi,Y2, ...) where Yk = Xk — Xk-i (and where we always set 
Xq = 0). Let fik{x) = E{Yk\Xk-i ~ x), that is ^k{Xk-i) is a version of E{Yk\Xk-i)- We call the 
sequence X centering if for each k = 2,3,... we may take /ifc(x) to be a non-increasing function of 

X. 

Theorem 2.6. Let Xi,X2, ■■■,Xn be a centering sequence with 

corresponding differences Yk — Xk — Xk-i satisfying < Yfe < 1 for each k. Then 

P{Xn > (1 + e)E{Xr,)) < exp l^-^e^E{xS^ < e < 1; 

1 

Proof 

See 0. 

Remark 



P(Xn < (1 - e)E{Xr,)) < cxp ( -le^E{Xn) ) < e < 1 



□ 



Considering the Bernoullian scheme as in proposition (|2.3p . let y„ = X„— X„_i we have E{Yn\Xn-i) '■ 
j:^^ — for all n > 1, then X„ is a centering sequence. 

Corollary 2.7. Under the hypothesis of proposition i2.3\) we have 

P{X,, > (1 + e)E{X,,)) < exp (^-r/E{X^)^ ^ ^-k-^V2^^ < e < 1 (14) 
P(X„ < (l-e)i;(X„)) <cxp(^-ie2^(X„)^ 0<e<l (15) 

Proof 

The thesis is an obvious consequence of (fTTj) and theorem (|2.6p . 

□ 

Proposition 2.8. Let Xi, X2, Xn be a centering sequence with corresponding differences Yk = 
Xk—Xk-i with mean /i^ = Yk and suppose that there are constants Uk and bk such that ak <Yk < bk 
for each k. Then for any h > 



k=l 

Proof 



E{exp{hX„)) < TT ( + t^f^^^Hb, \ (^g) 

\ i^':-ak bk - Ok I 
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See g]. 



□ 



Corollary 2.9. Under the hypothesis of above proposition, if Ok = and bk = 1 then 



E{exp{hXn)) < (1 - a + ae'')' 



(17) 



where a = 



n 



Proof 



See [2]. 



□ 



Remark 



From pT|) wc have a ^ 



recalling (|17p then for n +oo 



E{exp{hX,,)) ~ e^(""-^)^ 



(18) 
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3 Appendix 

First we rewrite ([5]) as 



Pn,k = Pn,k-1 + [ k + -g^^] Pn,k - kpn+i.k+i, Vn > 0, 0<k<n+l (19) 



Pn,-i = 0, Vn > 



where 



We define 

+ 00 +00 +00 n 

^(^' y) = E E ■>=''y'pn,k = E E ^"y'pn,k (20) 

n=0 fe=0 n=0 k=0 

substituting into (|19p : 

+CXD n +00 n n 



J2 x"y''Pn,k = E E V,fc-i + E E ^"y''^Pn,k+ 

n=Ok=0 n=Ofc=0 ri=0 fc=0 

+00 n +00 n 

^^x"/-fcp„+i,fe + ^^a;"y'^^-^p„,fc (21) 



n=0 fe=0 n=0 fc=0 

After the computation of the all summands of (HH, we recover that: 



F{x, y) - yF{x, y) + 2;F^(a;, y) - ^Fy{x, y) + - f F{x, t)dt (22) 

^ y Jo 

Now from p2[) multiplying both members by y and computing the derivative respect to y we have 
y^—^Fyy{x, y) + f ^ - y\ Fy{x, y) - 2F{x, y) = (23) 



X \ ^ 

Proposition 3.1. For < x < 1, < y < 1 let 

F{x,y) = l + y — (24) 

fc=i 11/1=0 /l+l-' 

i/ien ([^p is a solution of \2S\) verifying the conditions F{0,y) = F{x,0) — 1. 
Proof 



From ([23)) we note that the variable x does not appear in the derivatives, therefore we treat it as a 
parameter. 

For convenience we put, for < a; < 1, 



then becomes 



Fyyix,y) + ^-^Fy{x,y) - —F{x,y) = 
ay ay 



We follow Frobenius method. The solutions of the indicial equation 

A(A - 1) + A- = 
a 



are Ai = and A2 = 1 — ^. 

Since A2 < Ai then all the solutions of ([^5)) will be of the type 

F{x,y) = Ci{x)Fi{y) + C2[x)F2[y) 

where 



+ CXD 



Fi{y) = ^cky^, 

+ CJO 



fc=0 



where the constant C is equal to zero if Ai — A2 is not an integer, i.e. x 1 ~ ^. 
After computing the derivatives of Fi (y) and substituting in (|23p we recover that 



co = l 



thus 



From (l25l) we have 



k=i n^=o + ^) 



F{x,y) = i+Y^ ""'y' 



fe=l 11/1=0 h+l) 

is well defined even if a; = and we have F(0, y) ~ F{x, 0) = 1. 
This conclude the proof. 



Proposition 3.2. Let F{x, y) as in I24\l th 

H-oo n 1 

F(.,y) = l + ^^.VT:TE^ 



H-oo n -1 ^ / ■ \ n— /c 



where 



A - 1 = 

Ll.h=l,h^i\^ h+1 I ) 



Proof 

Let 



because 



then 



Choosine: x = ^-^T we obtain 



From (E3 



0fe = TTk TT—hT^, k> 1 

iih=(n '1+1/ 



k ^ 
1=1 i+i 



j=l h—l,hy^i 



+00 1 4 



+ 00 -J A; -\-oo / 

fe=l i=l r=0 ^ 



fc— 1 1 s- 

Inverting the order of the last summations it fohows that 



k +00 / . \ s — \ 



= 1 + E -'y'^ E E ^'^^ V z + 1 

S=l 2=1 ^ 

= i + EE-v^E^ ^ ^ ^ 



k—l n—k 2—1 
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Inverting the order of the first two summations we have 

+00 n 1 ^ / ■ ^ n—k 



n=lfc=l i=l ^ 



The thesis follows. 



Remark 



From (P7|) taking into account (|20p for n > fc > 1 it follows that 



1 ■^-^ . / « 



Now we conclude proving that (|29|) is the solution of the initial system 
Proposition 3.3. Let pn^k o,s in i29\) then it solves 

Proof 

We proceed by induction. Let fc = 1 in this case we have 



1 
2 

from above equality substituting in ([25]) it follows that 



1 / ■ \ ri+1-1 111 / • \ n-1 



i=l ^ ' i=l ^ 

then the thesis, remembering that Ai.i = 1. 
For fc = 2, n and n > 1 substituting in ([29)) we have 



, fc / • \ n+l — k , ^ k / ■ \ n — k -, -, fc — 1 

1 x-^ . / t \ k 1 . / I \ 11 



2—1 ^ ^ ?' — 1 ^ ^ ^ ' ?'— 1 ^ ^ 

multiplying both members for fc! and eliminate by algebraic calculation the terms with index ; 
we have 



fc-l / . X ri+l-fc , fc-1 / . X ri-fc fc-1 / . \ ?i-fc+l 

I \ fc v-^ . / « \ . / « \ 



z— 1 ^ z— 1 ^ Z— 1 
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So that we have to verify that 



k—l / . \ n—k r 

I 



^ U: + 1 



A 



i.k 



i+l J k+1 



k . . ( i 

Aih — A; fc_i 



From ([50]) for fc = 2 wc have 



1 / . X n-2 

I 



^ (i + l 



i+l 2+1 



i + l 



because 



1 



and remembermg that Ai_i = 1. 

For fc > 2, let us observe that for every i = 1, ...,k — 1 we have 



^^h=l,h^^^ \ ^ h+1 i 



^ / 1 1/1=1, h+l i ) 



i+l k+l 



\.lh=l,h^i\'' h+l I I 



I k *1 k i + I 



i + l k+l i + l \ k + l i 



\.lh=l,h^i\'' h+l I I 



i+l k+l i+l k+l 



= 



then the thesis follows. 



We proceed to establish a compact form for the Pn,k- 

Proposition 3.4. Under the hypothesis of proposition iS.Sp for n> k >l 

I 



-I fe /; I i\ / ■ \ n-k 

I ^^k-^(k+l\,k I * 



k\ ^' \i + l)^ \i + l 



Proof 
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From wc have that 




Vfc > 1 



so that 



n ' 



i + 1 



h i + 1 
h + 1 i 



fe-l k 



n 



i — h 



1 i + 1 



(i + l)(/i + l) 

n (*-'^) 



k 



h=l,h^i 



Let i = k: then 



1 fc + 1 



n 



/c'^-i + 1)! 



(fc-1)! 



1 



Let i < k: then 



^ ^ ^ h=i+l 

i'=(fc + l)!^ ' ^J-^A^^ ^ ifc(fc + l)!^ ^ ^ ' 

so that 



then the thesis follows. 
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